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Foreword 



The present document describes the detailed mapping of the general audio service employing the aacPlus general audio 
codec within the 3GPP system. 

The contents of the present document are subject to continuing work within the TSG and may change following formal 
TSG approval. Should the TSG modify the contents of this TS, it will be re-released by the TSG with an identifying 
change of release date and an increase in version number as follows: 

Version x.y.z 

where: 

X the first digit: 

1 presented to TSG for information; 

2 presented to TSG for approval; 

3 Indicates TSG approved document under change control. 

y the second digit is incremented for all changes of substance, i.e. technical enhancements, corrections, 
updates, etc. 

z the third digit is incremented when editorial only changes have been incorporated in the specification; 
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Scope 



This Telecommunication Standard (TS) describes the SBR encoder part of the Enhanced aacPlus general audio codec 

[3]. 



Normative references 



This TS incorporates by dated and undated reference, provisions from other publications. These normative references 
are cited in the appropriate places in the text and the publications are listed hereafter. For dated references, subsequent 
amendments to or revisions of any of these publications apply to this TS only when incorporated in it by amendment or 
revision. For undated references, the latest edition of the publication referred to applies. 

[1] ISO/IEC 14496-3:2001/Amd. 1:2003, Bandwidth Extension. 

[2] ISO/IEC 14496-3:2001/Amd.l:2003/DCOR1. 

[3] 3GPP TS 26.401 : Enhanced aacPlus general audio codec; General Description 

3 Definitions, symbols and abbreviations 

3.1 Definitions 

For the purposes of this TS, the following definitions apply: 

band: (as in limiter band, noise floor band, etc.) a group of consecutive QMF subbands 

chirp factor: the bandwidth expansion factor of the formants described by a LPC polynomial 

Down Sampled SBR: the SBR Tool with a modified synthesis filterbank resulting in a down sampled output signal 
with the same sample rate as the input signal to the SBR Tool. May be used whenever a lower 
sample rate output is desired. 

envelope scalefactor: an element representing the averaged energy of a signal over a region described by a 
frequency band and a time segment 

frequency band: interval in frequency, group of consecutive QMF subbands 

frequency border: frequency band delimiter, expressed as a specific QMF subband 

noise floor: a vector of noise floor scalefactors 

noise floor scalefactor: an element associated with a region described by a frequency band and a time segment, 
representing the ratio between the energy of the noise to be added to the envelope adjusted HE 
generated signal and the energy of the same 

patch: a number of adjoining QMF subbands moved to a different frequency location 

SBR envelope: a vector of envelope scalefactors 

SBR frame: time segment associated with one SBR extension data element 

SBR range: the frequency range of the signal generated by the SBR algorithm 

subband: a frequency range represented by one row in a QMF matrix, carrying a subsampled signal 

time border: time segment delimiter, expressed as a specific time slot 

time segment: interval in time, group of consecutive time slots 
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time / frequency grid: a description of SBR envelope time segments and associated frequency resolution tables as 
well as description of noise floor time segments 

time slot: finest resolution in time for SBR envelopes and noise floors. One time slot equals two subsamples 

in the QMF domain 

3.2 Symbols 

For the purposes of this TS, the following symbols apply: 

Description of variables defined in one sub clause and used in other subclasses. 

ch is the current channel, and when used as index in vectors left channel is represented by ch= and 

right channel is represented ch= 1 . 

^Orig has Le columns where each column is of length Nlo^ or Nntgh depending on the frequency 

resolution for each SBR envelope. The elements in ^orig contains the envelope scalefactors of the 
original signal. 

^ ~ ^TabieLow^^TabieHigh ^as two column vcctors containing the frequency border tables for low and high frequency 
resolution. 

FSgg,^ internal sampling frequency of the SBR Tool, twice the sampling frequency of the core coder 

(after sampling frequency mapping. Table 4.55). The sampling frequency of the SBR enhanced 
output signal is equal to the internal sampling frequency of the SBR Tool, unless the SBR Tool is 
operated in downsampled mode. If the SBR Tool is operated in downsampled mode, the output 
sampling frequency is equal to the sampling frequency of the core coder. 

f Master IS of length A^Majter+l ^nd Contains QMF master frequency grouping information. 

frahieHigh IS of length NHigh+^ and contains frequency borders for high frequency resolution SBR envelopes. 

frabieLow IS of length Nlow+^ and contains frequency borders for low frequency resolution SBR envelopes. 

(rabieNoise IS of length A^g+1 and contains frequency borders used by noise floors. 

kx the first QMF subband in the SBR range. 

ko the first QMF subband in the f Master table. 

Le number of SBR envelopes. 

Lq number of noise floors. 

M number of QMF subbands in the SBR range. 

middleBorder points to a specific time border. 

A^^ number of limiter bands. 

Nmaster number of frequency bands in the master frequency resolution table. 

Nq number of noise floor bands. 

n = [A^^„,^, , N fj- . ] number of frequency bands for low and high frequency resolution. 

numPatches a variable indicating the number of patches in the SBR range. 

numTime Slots number of SBR envelope time slots that exist within an AAC frame, 16 for a 1024 AAC frame . 

panOffset = [24,12] offset-values for the SBR envelope and noise floor data, when using coupled channels. 
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patchBorders a vector containing the frequency borders of the patches. 

patchNumSubbands a vector holding the number of subbands in every patch. 

Qorig has Lq columns where each column is of length Nq and contains the noise floor scalefactors. 

r = [rQ,...,r^_j] frequency resolution for all SBR envelopes in the current SBR frame, zero for low resolution, one 
for high resolution. 

reset a variable in the encoder and the decoder set to one if certain bitstream elements have changed 

from the previous SBR frame, otherwise set to zero. 

Ie is of length L^+l and contains start and stop time borders for all SBR envelopes in the current 

SBR frame. 

tHFAdj offset for the envelope adjuster module. 

tHFGen offsct for the HF-gcncration module. 

tg is of length Lq+\ and contains start and stop time borders for all noise floors in the current SBR 

frame. 



3.3 Abbreviations 

For the purposes of this TS, the following abbreviations apply. 

NA Not Applicable 

aacPlus Combination of MPEG-4 AAC and MPEG-4 Bandwidth extension (SBR) 

Enhanced aacPlus Combination of MPEG-4 AAC, MPEG-4 Bandwidth extension (SBR) and MPEG-4 
Parametric Stereo 

QMF Quadrature Mirror Filter 

SBR Spectral Band Replication 



4 Outline description 

This TS is structured as follows: 

Section 5.1 gives an encoder overview description. Section 5.2 gives a detailed description of the filterbanks used in the 
encoder. Section 5.3 gives a specification of the used frequency band tables. Section 5.4 gives a detailed description of 
the time grid calculation and the transient detection. Section 5.5 gives a detailed description of the envelope estimation. 
Section 5.6 gives a detailed description of the estimation of the additional control parameters. Section 5.7 gives detailed 
description of the data quantisation. Section 5.8 gives a detailed description of the envelope coding. 



5 SBR encoder description 

5.1 SBR tools overview 

The encoder part of the SBR tool estimates several parameters used by the high frequency reconstruction method on the 
decoder side. In order to synchronise the SBR bitstream data with the AAC codec, the two different modes of operation 
have to be considered; normal aacPlus operation and aacPlus parametric stereo operation. In the normal case, the AAC 
encoder is responsible for downsampling of the input PCM signal, while the SBR encoder works in parallel on twice the 
sampling frequency compared to the downsampled signal. When using parametric stereo aacPlus, the SBR tool is also 
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responsible for downsampling of the AAC coder signal. The two modes are outlined in the following sections and 
illustrated in Figure 1 and Figure 2. 
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Figure 1 aacPlus block diagram 
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Figure 2 Parametric stereo aacPlus blocit diagram 

5.1 .1 Enhanced aacPlus sdynchronization without parametric stereo 

The time domain input PCM signal is assumed to be stored in a buffer x, where 2048 new samples are added to the end 
of the buffer every frame. Before adding new samples, all samples in the buffer must be left-shifted 2048 samples. The 
buffersize amounts to 576 + 2048 + finputoeiay samples, where finputoeiay equals the total AAC delay, i.e. the delay for the 
entire encoder - decoder chain, plus the SBR decoder buffer delay minus the SBR encoder buffer delay. All delays are 
expressed in the SBR input sampling rate: 

hnputDeiay = totAACDeluy + SBRDeluyDec - SbrDelayEnc 

The PCM buffer x is fed to the analysis QMF bank, where subband filtering is performed. The window stride of the 
QMF bank is illustrated in Figure 3a, which shows that the first window is applied from sample to sample 639 on the 
PCM buffer. The output from the analysis QMF bank: 32 subbands having 64 frequency channels each, is stored in the 
matrix X (Figure 3b) as 

X{k,l + qmfWriteOjfset), 0<k<6A, < / < numTimeSlots ■ RATE 

A delay of qmfWriteOffset subband samples is hence introduced, making 

SbrDelayEnc = 32 • 64 = 2048 

The algorithmic buffer delay in the decoder is 6 subband samples, giving 

SBRDelayDec = 6 • 64 = 384 

The total AAC delay is the delay introduced by the 1024 point MDCT transform, the window switching look-ahead and 
the delay introduced by the downsampling filter. If other delays are introduced these of course have to be accounted for. 
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(a) QMF analysis windowing of input signal 
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h< ►! 

qmfWriteOffset 

(b) subband sample buffer X 

Figure 3 aacPlus encoder buffers and synchronisation 

5.1 .2 Enhanced aacPlus synchronisation with parametric stereo 

The time domain input PCM signal is assumed to be stored in a buffer x, where 2048 new samples are added to the end 
of the buffer every frame. Before adding new samples, all samples in the buffer must be left-shifted 2048 samples. The 
buffersize amounts to 576 + 2048. Note that two buffers are needed for stereo signals. 

The PCM buffer is fed to the analysis QMF bank, where subband filtering is performed. The window stride of the QMF 
bank is illustrated in Figure 4a, which shows that the first window is applied from sample to sample 639 on the PCM 
buffer. The output from the analysis QMF bank: 32 subbands having 64 frequency channels each, is stored in the matrix 
H (Figure 4b) as 

H(;t,/ + 6), 0<;t<64, 0< I < numTimeSlots xRATE 

Two buffers are needed for stereo operation. The subband samples in the matrix H are fed to the hybrid filter bank (See 
[5]) which introduces a delay of 6 subband samples. Parametric stereo parameters are extracted from the output of the 
hybrid filterbank and downmixing of the stereo signal is performed. Subsequently, hybrid synthesis filtering is applied 
to the modified hybrid subband samples. 

The downmixed subband samples are fed to the subband matrix X (Figure 4c) as 

X{k,l + qmfWriteOffset), 0<k<64, 0<l <numTimeSlotsxRATE 

whereafter 'normal' SBR operation is undertaken. The subband samples are in parallell fed to the 32 channel synthesis 
filter bank. The stride for the synthesis windowing is illustrated in Figure 4d. The output from the filterbank, having a 
sampling frequency half of the SBR sampling frequency is forwarded to the AAC encoder. 

After SBR processing of the current frame, an additional delay of one frame has to be introduced by delaying the SBR 
frame data (Figure 4e). 

To achieve synchronisation, the total AAC codec delay is bound to be 3200 samples, expressed in the SBR input 
sampling frequency. 
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Figure 4 Enhanced aacPlus stereo synchronisation 

5.1 .3 SBR encoder modules overview 

The modules of the encoder part of the SBR tool are illustrated in the block diagram of Figure 5. The SBR tool operates 
on discrete mono signals in general, but some of the modules in Figure 5 need simultaneous access to both the left and 
right signal in case of stereo signals. 
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• As outlined in 5.1.1 and 5.1.2, the time domain signal is first filtered by the 64 channel complex QMF bank 
(section 5.2). The output from the analysis QMF bank: 32 subbands having 64 frequency channels each, is 
stored in the matrix X as 

X{k,l + qmfWriteOJfset), 0<k<64, 0<l <numTimeSlots- RATE 

Several modules use the output from the QMF bank; 

• The transient detector operates on the matrix X starting at subband sample 0. 

• The frame splitter operates on the matrix X starting at subband sample 0. 

• The output from the transient detector and frame splitter is fed to the frame generator, where the time and 
frequency resolutions for the current frame are determined. 

• The Tonality detector operates on the matrix X starting at subband sample qmfWriteOffset. 

• The control data from the Tonality detector and also the current time and frequency grid is forwarded to the 
unit for Additional control parameters. In this module, the levels of the adaptive noise, inverse filtering and 
additional sines are determined. 

• The Envelope energy formatter operates on the matrix X starting from subband sample 0. The unit needs the 
time frequency grid and the additional control data as inputs. 

• The formatted envelope data is subsequently quantised and Huffman coded, before being fed to the Bitstream 
multiplexer, where all SBR data is formatted and packed into a SBR frame. The SBR frame is transmitted as a 
fill-element in the bitstream multiplex together with the AAC channel element for the current frame. In case of 
a Parametric stereo SBR element, the current SBR frame is delayed one frame before entering the bitstream 
multiplexer (Section 5.1.2 ). 
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Figure 5 Sbr Encoder overview 



5.2 Analysis filterbank 



Subband filtering of the input signal is done by a 64-subband QMF bank. The output from the filterbank, i.e. the 
subband samples, are complex-valued and thus oversampled by a factor two compared to a regular QMF bank. The 
flowchart of this operation is given in Figure 6. The filtering comprises the following steps, where an array x consisting 
of 640 time domain input samples are assumed. Higher indices into the array corresponds to older samples: 

• Shift the samples in the array x by 64 positions. The oldest 64 samples are discarded and 64 new samples are stored 
in positions to 63. 

• Multiply the samples of array x by window C. The window coefficients are found in Figure 6. 

• Sum the samples according to the formula in the flowchart to create the 128-element array U. 

• Build two arrays, r and i, from u by the operations 

r[n) = u[n) — u[l27 — n) 



i(«) = M(?i) + M(127 — «) 



,0<n<64 



Calculate 64 new complex-valued subband samples, X = R H- i I, where i is the imaginary unit, by DCT and DST 
type III transforming r and i according to 
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R(^) = Vr(«)cos 

n=0 
63 

l(fc) = V/(?i)sin 



n 



64 



k + — \n 

2 



64l l) 



,0<yt<64 



Every loop in the flowchart produces 64 complex-valued subband samples, each representing the output from one 
filterbank subband. For every SBR frame the filterbank will produce numTimeSlots ■ RATE subband samples from 
every filterbank subband, corresponding to a time domain signal of length numTimeSlots ■ RATE ■ 64 samples. In the 
flowchart X[k][l] corresponds to subband sample 1 in QMF subband k. 
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For n = to 63 do 
r[n]= u[n]-u[127-n] 
i[n] =u[n] + u[127-n] 



Apply DCT and DSTtype III transforms to r and 1 and output result 


For k = to 63 do 
63 
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63 
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= ILi[n]*sin(7i/64*(k + 0.5)*n) 
n=0 
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Done 



Figure 6: Flowchart of encoder analysis QMF bank 
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5.3 Frequency band tables 



The SBR encoder use these different frequency band tables: f^„„^^ , fj,,i,u,^, , ^j^eto^^ and ij„u,^„„, , which are defined 

according to subclause 4.6.18.3.2 in [1]. The parameters needed to define all frequency band tables are transmitted in 
the SBR bitstream header. For SBR header bitstream elements enabled with either bs_header_extra_l or 
bs_header_extra_l there are default values and hence a transmission of these elements are only needed if they differ 
from the default value. Default values are defined in subclause 4.5.2.8. 1 in [1]. The SBR header parameters are 
regarded as tuning parameters since they are strongly bitrate and sampling frequency dependant Throughout the tuning 
work for 3GPP submission several bitrate and sampling frequency dependant tunings have been created and in the 
reference c-code there are tunings available from 8kbit/s mono to 48 kbit/s stereo. 

5.4 Time / frequency grid generation 

An introduction to the time / frequency grid generation, including a brief discussion of the frame classes, is given in the 
informal encoder description in [1], subclause 4.B.18.3. The present encoder implementation employs three tools for 
the grid generation: 

• The Transient Detector (TD) 

• The Frame Sphtter (FS) 

• The Frame Generator (FG) 

Those tools are described in the subsequent sections. Figure 7 shows the ranges of the frame classes and the transient 
detector offset versus the indices used by the frame generator. 

I ^ tranPos > | 

l-l-l-l-l-l-l-l-l-l-l-l-l-l-l-l-l 

0123456789ABCDEF TD index (hexadecimal) 

I < FIXFIX > I 

I < FIXVAR >:< >: 

:< >:< VARFIX >| 

:< >:< VARVAR >:< >: Ybuf f er 

QMF slots 

I-|-|-|-|-|-|-|-|-|-|-|-|-|-|-|-I°l°l°|-|-|-|-|-|-|-|-|-|-|-|-|-I SBR slots 
4 8 16 19 32 FG index 

I: nominal frame boundaries 
o: frame overlap region slots 

Figure 7: The four frame classes and the transient detector range 

5.4.1 Transient detector 

The transient detection is performed according to the pseudo-code below. It operates on subband samples of one frame 
length starting from sample 8. The output from the transient detector are the variables tranFlag and tranPos. The first is 
a boolean indicating whether there is a transient in the processed frame, and the second specifies the position (in time 
slots) for the on-set of the transient. The time / frequency grid generation module uses the output from the transient 
detector and the stored transient detection output from the previous frame to perform its operations. 



for[n = 0;n <16;?i-l--l-) 

for (n = 16; n< 4^; n + +) 
a{n) = 
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X{i,l-lNT\'^—^\ + \) 



X(i,2-INTi'^^} + l) 



if{R-L>t{i)) 



fl(?i) = fl(?i) + 



R-L-t{i) 

^(0 



for[n = %;n<AQ;n + +) 



V ^ y 



if\ a{n)<— a{n-\) AND a{n-\)> 2^3.125 

tranPos = INT 

tranFlag = 1 
break 

tranPos = 
tranFlag = 

t and a are static channel-dependent arrays of length 64 that needs to be stored in between calls to the transient detector. 
On start-up, all elements in both arrays must be set to zero. 



else 



5.4.2 Frame splitter 

The frame splitting is accomplished according to the following algorithm. It is only active when the transient detector 
has detected the absence of a transient in the current frame of interest, i.e. when tranFlag = 0). It operates on subband 
samples of one and a half frame length starting from subband sample 0. The output from the frame splitter is the 
variable splitFlag, which indicates whether the current frame (free from transients) should be divided into two 
envelopes of equal size. 
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,. „, totalBitRate „ ^ ^ 

splitlhr = 7.5e — 5- 

codecBitrate 



frameSize ^^^ 



sampleFreq 



-2 



sbrStartBand-l 47 



ecurrl„.= Z Zl^(^''")|' 



i=0 n=16 






n(///) B(HI) 

^currhigh ~ 2-1 ^A's/iV^' / 2-1 ^/msAV^' V 

;j=0 ;j=0 

£? -t- ^ 

2currlow prevlow 
lOT ^ '^currhigh ^ 



2 



^^,,^,(;.,l) + 8e6^ 



^/.„/.(P'0) + 8^6 



\^ high 



, 0<p<n(///) 



uvtcyp) 



c? = Z dvec(p)^ 



if{d> splitThr) 

spUtFlag = 1 

splitFlag = 

prevlow currlow 

The variable £„„„£„». is a static channel-dependent variable that must be stored in between calls to the frame splitting 
module. This variable should be set to zero on start-up. 

5.4.3 Frame generator 

The frame generator creates the time/frequency grid for one SBR frame. Input signals are provided by the transient 
detector and the frame splitter. The frame generator produces two outputs: The sbr_grid() portion of the bitstream, and 
an internal representation of the time/frequency grid to be used by the envelope and noise floor estimators, see Figure 5. 

When no transients are present (i.e. tranFlag = 0), FIXFIX class frames are used. The frame splitter decides whether to 
use one or two envelopes in the FIXFIX frames (splitFlag = or splitFlag = 1 respectively). "Sparse" transients 
(separated by one or more frames with tranFlag = 0) are coded by means of FIXVAR-VARFIX sequences. "Tight" 
transients ( tranFlag = 1 for two or more consecutive frames) are handeled by inserting VARVAR class frames. 

As most transients are "sparse", the frame generator prepares a grid for a FIXVAR-VARFIX pair upon detection of a 
transient after a sequence of FIXFIX frames. The present frame is encoded using the FIXVAR portion, and the 
VARFIX grid is stored. At the next call of the generator it is known whether the transient actually is "sparse" or not. If 
'yes', the already calculated and stored VARFIX grid is used. If 'no', a new grid, meeting the requirements of the new 
transient, as well as those of the previous one, is calculated, whereby a VARVAR class frame is used. 

The operation of the frame generator is further described below by means of pseudo-code, where the syntax 

[outi), outi, ..., out^.i] = function(ino, in\, ..., /«„-!) is used. 

FrameGenerator {tranFlag, tranPos, splitFlag) 

{ 

static f rameClassOld; // frameClass used for previous frame 

static Gl; // grid designed during previous call 

[frameClass, f rameClassOld] = calcFrameClass {f rameClassOld, tranFlag); 

if (tranFlag) 



£75/ 



3GPP TS 26.404 version 8.0.0 Release 8 1 8 ETSI TS 1 26 404 V8.0.0 (2009-01 ) 

GP = f illFrameTran (tranPos) ; // load transient borders into GP 

switch (frameClass) { 
case FIXFIX: 

BS = calcSbrGrid {FIXFIX, dc , splitFlag) ; 

break; 
case FIXVAR: 

if {tranPos > 8) 

GP = f illFramePre (GP) ; // append borders before transient borders 

if {tranPos < 10) 

GP = f illFramePost (GP) ; // append borders after transient borders 

[GO, Gl] = splitAndStore (GP) ; // split GP into two grids, GO and Gl 

BS = calcSbrGrid {FIXVAR, GO, dc) ; // calc BS using GO 

break; 
case VARFIX: 

BS = calcSbrGrid {VARFIX, Gl , dc); // calc BS using Gl {from previous call) 

break; 
case VARVAR: 

GP = f illFramelnter {Gl, GP) ; // resolve conflicts and merge Gl and GP 

if {tranPos < 10) 

GP = f illFramePost {GP) ; // append fill-borders after tran-borders in GP 

[GO, Gl] = splitAndStore {GP) ; // split GP into two grids, GO and Gl 

BS = calcSbrGrid {VARVAR, GO, dc); // calc BS using newly designed GO 

break; 
} 

return [BS, FI = decodeSbrGrid {BS) ] ; // decode BS into FI 



The following pseudo-variables are defined: 



GP = "Grid-Pair" : 

- GP.aBorders 

- GP.aFreqRes 

- GP . iTran 



array holding envelope borders of two consecutive frames 

array holding envelope frequency resolutions of two consecutive frames 

index of transient leading border 



Gi = "Grid instance i" : 

- Gi . aBorders : array holding envelope borders of one frame 

- Gi.aFreqRes: array holding envelope frequency resolutions of one frame 

- Gi . iTran : index of transient leading border of one frame 

BS = "Bit-Stream" : 

- sbr_grid{) as defined in [1] Subclause 4.4.2.8, Table 4.61A 

FI = "Frame-Info" : 

- FI.t_E: tg , envelope borders as defined in 3.2 

- FI .r 

- FI . t_Q 

- FI .1 A 



r = [rQ,...,r^_j] , envelope frequency resolutions as defined in 3.2 

tg , noise floor borders as defined in 3 . 2 

/a , index of border where the preceding envelope is to be "shortened" 



the symbolic constant, 

dc : don't care 

and the operations 



cat {a, b) 
length {a) 
fliplr{a) 
ones {a) 



concatenate vectors a & b 

number of elements of vector a 

reverse order of elements of vector a 

generate vector of length a, were all elements are 1 



The internal functions are defined below: 



calcFrameClass {f rameClassOld, tranFlag) 

{ 

switch {f rameClassOld) { 
case FIXFIX: 
if {tranFlag) 
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frameClass = FIXVAR;// stationary to transient transition 
else 

frameClass = FIXFIX;// when no transients are present, FIXFIX frames are used 
break; 
case FIXVAR: 
if (tranFlag) 

frameClass = VARVAR;// "tight" transients are handeled by VARVAR frames 
else 

frameClass = VARFIX;// "sparse" transients are handeled by [FIXVAR, VARFIX] pairs 
break ; 
case VARFIX: 
if (tranFlag) 

frameClass = FIXVAR; 
else 

frameClass = FIXFIX;// transient to stationary transition 
break; 
case VARVAR: 
if (tranFlag) 

frameClass = VARVAR;// "tight" transients are handeled by VARVAR frames 
else 

frameClass = VARFIX; 
break; 
} 

f rameClassOld = frameClass; 

return [frameClass, frameClassOld] ; 
} 

f illFrameTran (tranPos) 

{ 

GP.aBorders = {tranPos + 4, tranPos + 6, tranPos + 10 }; 

GP.aFreqRes = {O, 0, l}; 

GP . iTran = ; 

return GP; 
} 

f illFramePre (GP) 

{ 

aBordersFill = f illHelper (GP . aBorders [0] , 8); 

GP.aBorders = cat (fliplr (aBordersFill) , GP.aBorders); 

GP.aFreqRes = cat (ones (length (aBordersFill) ) , GP.aFreqRes); 

GP. iTran += length (aBordersFill) ; 

return GP; 
} 

f illFramePost (GP, tranPos) 

{ 

if (tranPos < 4) 

maxStep = 6 ; 
else if (tranPos == 4 | | tranPos == 5) 

maxStep = 4 ; 
else 

maxStep = 8 ; 
aBordersFill = f illHelper ( (32 - GP . aBorders [length (GP . aBorders) - 1], maxStep); 
GP.aBorders = cat (GP . aBorders, aBordersFill); 
GP.aFreqRes = cat (GP . aFreqRes, ones (length (aBordersFill) )) ; 
return GP; 
} 

splitAndStore (GP) 

{ 

iSplit = 0; 

while (GP.aBorders [iSplit] < 16) 

iSplit++; 
for (i = 0; i <= iSplit; i++) { 

GO .aBorders [i] = GP . aBorders [i] ; 

GO .aFreqRes [i] = GP . aFreqRes [i] ; 

} 

GO . iTran = GP. iTran; 

for (j = 0, i = iSplit; i < length (GP . aBorders) ; i++, j++) { 
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Gl.aBorders [j] = GP . aBorders [i] - 16; 
Gl.aFreqRes [j] = GP . aFreqRes [i] ; 

} 

Gl.iTran = GP . iTran - iSplit; 



As evident from the pseudo code, every transient is initially processed by fillFrameTran() by inserting one border at the 
onset of the transient, and two "decay" borders after the onset at the distances 2 and 6 slots from the first border 
respectively. The frequency resolutions of the two corresponding envelopes are 'low', whereas all other envelopes use 
'high' resolution. Additional borders are inserted before said borders by fillFramePre() and fillFramePost(), such that no 
envelope exceeds the length 12 slots. The function fillHelper(A, B) subdivides the distance A by calculating segments 
quantized to the lengths {2, 4, 6, 8} slots while limiting the segment length to B. In split AndStore() the borders are 
separated into two groups, each associated with one frame. The above procedures are illustrated by Figure 8. 



tranFlag = 1 
tranPos = 9 



l-l-l-l-l-l-l-l-l-l-l-l-l-l-l-l-l 
0123456789ABCDEF 

|< 6 |<-2|<--4---|--- 

N I 

|< Frame n: FIXVAR :--3->|<-- 



TD index 

--6---->| 
N 
Frame n+1: VARFIX 



I-|-|-|-|-|-|-|-|-|-|-|-|-|-|-|-Io|o|o|-|-|-|-|-|-|-|-|-|-|-|-|-I 
7 13 15 19 25 32 



QMF slots 
SBR slots 
FG index 



nominal frame boundaries 
frame overlap region slots 
border pointed to by bs_pointer 
noise floor middle border 



Figure 8: Example of isolated transient 

In Figure 8. the borders at index 7, 13, 15 and 19 are used for the present FIXVAR class frame. Conversion into 
sbr_grid() bitstream elements is performed in calcSbrGrid(). The methods of the four classes for conversion of borders 
and frequency resolutions are implicitely defined by the bitstream and decoding equations in [1], subclause 4.4.2.8 
(Table 4.61A) and 4.6.18.3, and are hence not described here. In the example bs_var_bord_l = 3, bs_num_rel_l = 3, 
the relative borders have the lengths 4, 2 and 6 ("right to left"), and the frequency resolutions are 0, 0, 1, 1 ("right to 
left"). The bs_pointer is set to point to the transient leading border, i.e. the value is 3 since FIXVAR borders are also 
indexed "right to left", starting from 1 (0 signals that no transient leading border is present within the frame). The 
border at index 19 must be followed up in the next frame by a leading border at index 3. The border at 25, however, 
may or may not yield a border at 9, since a transient is possible in frame n+1. If the transient actually is "sparse", the 
VARFIX bitstream comprises of bs_var_bord_0 = 3, bs_num_rel_0 = 1, one relative border of length 6, bs_pointer = 
and frequency resolutions 1, 1. 

Figure 9. gives an example of "tight" transients, and also serves to outline the functionality of fillFrameInter(). Here Gl 
contains borders at index 1 and 7, but a transient is located already at index 6. In fillFrameInter() the preliminary border 
at 7 is simply removed, and the rest of the borders for the present frame are taken from GP. (If on the other hand the 
distance between the last border in Gl and the first border in GP exceeds 12, the segment inbetween said borders is 
subdivided analogously to the procedures in fillFramePre().) Hereafter GP is finalized and split in the same manner as 
described above, whereafter GO is converted into a bitstream using the VARVAR method of calcSbrGrid(). Hereby the 
leading border yields bs_var_bord_0 = 1 and the trailing border bs_var_bord_l = 2. Clearly bs_num_rel_0 = and 
bs_num_rel_l = 3. Figure 9. also shows that fillFramePost() has inserted a border at 18, thereby meeting the 
requirement that one border is present within the interval [16, 19]. This concludes the description of how to generate 
BS. 



tranFlag = 1 

tranPos = 2 

<T> 

I-l-l-l-l-l-l-l-l-l-l-l-l-l-l-l- 
0123456789ABCDEF 



TD index 
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QMF slots 
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1 6 7 8 12 18 24 32 FG index 



Figure 9: Example of tight transients 



The second output of the frame generator, FI, comprises of t^, r, tg and Z^- Since those signals are equivalent to their 
counterparts at the decoder side, the relation between FI and BS is fully defined by the decoding equations in MPEG-4. 
Thus, as the last step in the frame generator, the decodeSbrGrid() function parses and decodes the now available 
sbr_grid() portion of the bitstream in accordance with the description in the MPEG-4 standard, which shall not be 
repeated here. 



5.5 Envelope estimation 



By using the time/frequency grid created by the framing generator and the transient information from the transient 
detector, the QMF bank subband matrix is grouped in time and frequency into envelope scalefactorbands. For each 
scalefactorband the squared average energy is calculated and stored in the energy matrix E according to the recursion 
below. 

for {I = 0;1<L^;1 + +) 

temp I - < 

[0 , otherwise 

forip = 0;/7<n(r(/));p + +) 

1 ,p = 0,r{l) = HI,F{l,Hl)-'P{0,Hl)>l 
temp.^U ,;7 = 0,r(/) = LO,F(l,LO)-F(0,LO)>2 
, otherwise 

k,=F[p,r{l)) + temp^ 
k,=F{p + U{l)) 

RATEt^{l+l)-l *j-l 

z zix(i,or 

£/ A_ i=RATE-t^{l] j=k, 

(RATE-{t,{l + l)-temp,-t,{l)))-{k,-k,) 

If a missing harmonic has been detected in a certain scalefactorband the squared energy for that scalefatorband is 
calculated as the maximum energy instead of average energy. Since the missing harmonics detection and signalling 
always operate using the recursion shown below. 
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for (Z = 0;l < Lj,;l + +) 

/I >/ = /.-! 
temp I - < 

[0 ,otherwise 
for(p = 0;p<n[v{l));p + +) 

1 ,/7 = 0,r(/) = ///,F(l,///)-F(0,///)>l 
temp.^U ,/7 = 0,r(/) = LO,F(l,LO)-F(0,LO)>2 
, otherwise 

k,=F[p,r{l)) + tempi^ 

k,=F{p + U{l)) 

[0,398107267 ,k,-k,>l 
boostcomp = < 

[0,5 , otherwise 

for[k = ki;k <k^;k + +) 

RATEt^{l+l)-l 

z ix(^,or 



^,emp{k -K) = boostcomp ■- 



i^RATE-t^{l) 



(RATE-{t^{l + \)-temp,-t^{l))) 
E{p,l) = MAX(e,^^) 

For stereo with no channel coupling, the energy for every channel is calculated as in the mono case shown above. In the 
case of stereo and coupling the energy is calculated according to: 



E 

CoupUngRigh, 



^^^^^^ ^uMI)^^.ApA ^ 0<p<n(r(/)),0</<L, 



E 

CoupUngLeft \± ■ / ^ 



•^P^') = ,^^ Zy 0<P<n(r(/)),0</<L, 



5.6 Additional control parameters 
5.6.1 Introduction 

In order to achieve optimal results, given the HF generator used in the decoder, several additional parameters apart from 
the spectral envelope are assessed. The noise floor is estimated for the current SBR frame. It is defined as the ratio 
between the energy of the noise that should be added to a particular frequency band, in order to obtain a similar tonal to 
noise ratio to that of the original signal, and the energy of the HF generated signal for that frequency band. 

The noise floor is estimated once or twice per SBR frame dependent on the number of spectral envelopes estimated for 
the SBR frame (indicated by tg ). The frequency resolution for the noise floor scalefactor is calculated according to the 

same algorithm subsequently used in the decoder and described in [1] subclause 4.6.18.3. The start and stop time 
borders of the different noise floors are given from the time grid. 

The level of the inverse filtering applied in the decoder is estimated for different frequency ranges with the same 
frequency resolution as used for the noise floor scalefactor estimation. The estimation algorithm compares the tonality 
of the original and the tonality that will be attained after the HF generator in the decoder. The ratio between the two is 
mapped to four different inverse filtering levels, off, low, mid and high. These levels corresponds to different chirp 
factors in the HF generator as outlined in [1] subclause 4.6.18.5. Moreover, the encoder assesses where a strong tonal 
component will be missing after the HF generation in the decoder. This detection is done on the highest frequency 
resolution given by the high frequency resolution table, f-TaUeHigh- The level of the tonal component is implicitly coded 
by the SBR envelope and the noise floor scalefactors, and thus only the frequency needs to be coded. 
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5.6.2 Tonality estimation 

The following detection modules base their output on a tonality estimate calculated in the tonality estimation module: 

• Noise-floor estimation 

• Inverse filtering estimation 

• Additional sines estimation 

The tonality is derived fi-om the prediction gain of a second order linear prediction performed in every QMF subband. 
The LPC is calculated using the covariance method, and for every frame two tonality estimates are calculated for every 
subband. 

In the following, X is the matrix holding the most recently available complex QMF subband samples. The tonality 
values are calculated and stored in the T and Tsbr matrices. These also contain buffered values from previous frames. 
The Tsbr values are obtained from the T values by patching the tonality values similarly to the patching of the subband 
channels in the high frequency reconstruction modules in the decoder. 

Since the subband signals are complex valued, this results in complex filter coefficients for the linear prediction. The 
prediction filter coefficients are obtained from the covariance method. The covariance matrix elements for every 
tonality estimate calculated are: 



16-1 K+M-\ 1 fO<J<3 

^<3 



<^u(^i) = Z Z Y.^{k,n-i + \6-l)-X'{k,n-j + \6-l) A 

«=2 i=0 ;=o 1 1 — J ■ 



where k is the subband index, and / is the tonality estimate. 

Based on the covariance elements the coefficients Cfg (^) and a^ (fc) used to calculate the tonality estimates for the 
subbands are calculated as: 

d'(^) = ^u(2>2)-^,,(l,l)--^— K,(l,2)f, 



a[{k) = 



[ ^,,(0,l)-^,,(l,2)-^,,(0,2)-^,,(l,l) ^^,^^^^Q 

d' [k) 
,d\k) = Q 



a[{k) = 



\ <p,,{0,\)+a[{k)-<pl{\,l) 

,^„(i,i)=o 



where £"/„y is the relaxation parameter ( Sjnv = lE-6 ). 

The tonality values are calculated based on the above coefficients according to: 

re{a[{ky^l{0,\) + a[{k)-<l):,{0,2)} 



T{k,l + 2) = 



re{<t>,A^,0)]-re{a[{k)-<t>:,{0,l) + a\{k)-<t>l{0,2)} 



£re{<^,,,(0,0)} 
Nrg(/ + 2) = ^^5 

The tonality values are patched similarly to the patching of the QMF subbands in the decoder during high frequency 
reconstruction. Hence, it is possible to compare tonality of a "simulated" SBR signal and the original signal on the 
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encoder side. The patch used is built in accordance to the flowchart in Figure 4.46, subclause 4.6.18.6.3 in [1], where 
the output variable numPatches is an integer value specifying the number of patches. patchStartSubband and 
patchNumSubbands are vectors holding the data output from the patch decision algorithm. 

Hence, the tonality values for the SBR part is obtained according to: 

Tsbr()t,/ + 2) =T{p,l + 2) 

i-\ 
k = k^ + x + ^ patchNumSubbands (^) 
\ «=" 

p = patchStartSubband [i) + x 

for < X < patchNumSubbands (/), < / < numPatches, < / < 2 . 

5.6.3 Noise-floor estimation 

The noise floor estimation module estimates the amount of noise relative to the energy of the patched SBR signal that 
should be added on the decoder side in order to obtain a tonal to noise ratio similar to that of the original. The 
estimation is based on the tonality values in the T and Tsbr matrices, and the estimation is done for the number of 
frequency bands indicated by Nq , and the frequency ranges defined in frabieNoise for the time segments defined by tg . 

The algorithm below is outlined for noise floor band nfBand for noise floor nfEnv and should be applied for all noise- 
floor bands, and noise floors in the present frame. If the number of spectral envelopes for the present frame is larger 
than one, two noise floors will be estimated, otherwise one. For the case of two noise floors startlndex will be zero for 
the first noise-floor and one for the second noise-floor, while stoplndex will be one for the first noise-floor, and two for 
the second noise-floor. In case of only one noise-floor, the startlndex will be zero and the stoplndex will be one. 

The noise floor is calculated by averaging of the tonality values for the given time/frequency range, or by choosing the 
maximum tonality value. The latter is used if the additional sine detection algorithm detects that a sine should be added 
on the decoder side for frequency band that is included in the present noise floor frequency band. 

Hence, for every noise floor band the tonality values are calculated according to: 

tg («/Em.+l)-l fM,„v,„„, (n/Bfl«rf+l)-l 

I Z T(^,/) 



(Iq (nfEnv + 1) - tg (nfEnv)) ■ (fraUeNo^e (nfBand + 1) - fj,,,,^,,,,, (nfBand)) 

tg{„fE„v+l}-i fj.„,,,„v„,„ («/Bfl«rf+l)-l 

X I Tsbr(^,Z) 

TavgSbr = — - 

(tg (nfEnv + 1) - tg (nfEnv)) ■ (fr„M.iv„,,<. (nfBand + 1) - {raMeN„L.e (nfBand)) 

or, if a sine will be added at the decoder side as indicated by "missingHarmonicsFlag", according to: 

Tavg = max (max (T(k,l)),\) , ij^ueN„,.e (nfBand) <k< fj-abkNoise (nfBand + 1) ,te (nfEnv) < / < tg (nfEnv + 1) 
TavgSbr = max(max(Tsbr(^,Z)),l), fj^ueNoi.e (nfBand) <k< fj^ueNot^e (nfBand + l),tQ (nfEnv) < / < tg (nfEnv + l) 
The tonality values Tavg and TavgSbr are subsequently used to calculate the actual noise-floor value, according to: 



nS (nfBand, nfEnv) = min 



^ 1 ^ 

• nf Offset, nfMaxLevel 



Tavg 



if the additional sine detection has indicated that there is a sinusoidal missing in the present noise-floor band, or the 
inverse filtering level for the present noise-floor band is equal or below INVF_LEVEL_MID. If neither of these cases 
are true, the noise-floor value is calculated according to: 
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nf ( nfBand , nfEnv) = min 



max 



1,0.25- 



TavgSbr 

Tavg 



Tavg 



- • nf Offset, nfMaxLevel 



The noise-floor values are smoothed by applying a LP filter over time using previous noise floor values. Hence for 
every nfBand, the smoothing is done according to: 

2 

Q[nfBand , nfEnv) = nf [nfBand , nfEnv) • h (3) + ^h (/) • nf^,^^^, [nfBand, i) 

1=0 

where nfp„,, are the nf values from the previous estimates (where the most recent estimates is placed at the end of the 
vector, i.e. position 2), and h is defined as: 

h = [0.05857864376269, 0.2, 0.34142135623731, 0.4] 

5.6.4 Inverse filtering estimation 

The inverse filtering detection is done on the frequency bands indicated by (TahieNotse ■ For every band a tonality value is 
calculated from the original input signal and the "patched" SBR signal. The values are mapped to a specific regions 
given the "Region borders" in the detectorParamsAAC struct, and the appropriate inverse filtering value is given from 
the "Region space" also in detectorParamsAAC. 

typedef enum 

{ 

INVF_OFF = 0, 
INVF_LOW_LEVEL , 
INVF_MID_LEVEL , 
I NVF_H I GH_L E VE L 

} 

INVF MODE; 



tic const DETECTOR 
l.Of, 10. Of, 14.0 
O.Of, 3. Of, 7.0 

25. Of, 30. Of, 35.0 



.Of, 

{ INVF_MID_LEVEL , 
{ INVF_MID_LEVEL , 
{ INVF_HIGH_LEVEL , 
{ INVF_HIGH_LEVEL , 
fiNVF HIGH LEVEL, 



],/^ 



{ INVF_LOW_LEVEL , 
{ INVF_LOW_LEVEL , 
{ INVF_HIGH_LEVEL , 
{ INVF_HIGH_LEVEL , 
{ INVF_HIGH_LEVEL , 

},/* 

-4, -3, -2, -1, 0} 



PARAMETERS detectorParamsAAC = { 

Region borders SBR. */ 
Region borders Orig. */ 
Region borders Nrg. */ 
Number of borders SBR. */ 
Number of borders orig. */ 
Number of borders Nrg. */ 
Delta value for hysteresis. 
Region space. */ 
INVF_OFF , 
INVF_OFF , 
_ _ INVF_LOW_LEVEL 
INVF_HIGH_LEVEL, INVF_MID_LEVEL 
INVF_HIGH_LEVEL, INVF_MID_LEVEL _ 

regionOrig 

/* Region space transient. */ 
INVF_LOW_LEVEL , INVF_LOW_LEVEL , INVF_OFF 
INVF_LOW_LEVEL 
INVF_MID_LEVEL 
INVF_MID_LEVEL 
INVF MID LEVEL 



f, 19 


Of} 


/* 


f, 10 


Of} 


/* 


f , 40 


Of} 


/* 
/* 
/* 
/* 
/* 
/* 


INVF 


LOW 


LEVEL 


INVF 


LOW 


LEVEL 


INVF 


MID 


LEVEL 



INVF_ 
INVF_ 
INVF 



OFF, 
OFF, 
OFF, 



INVF 
INVF 
INVF 



OFF} 

off) 

OFF 



INVF_OFF , 
INVF OFF, 



INVF_OFF } 
INVF OFF 



INVF_LOW_LEVEL , 
INVF_MID_LEVEL , 
INVF_HIGH_LEVEL 
INVF HIGH LEVEL 



INVF_OFF , 
INVF_OFF , 
INVF_OFF , 
INVF OFF, 



INVF_OFF } 
INVF_OFF ) 
INVF_OFF ) 
INVF_OFF ) 
INVF OFF 



*/ 



/*regionSbr*/ 



I 



*/ 



/*regionSbr*/ 
/* I */ 



regionOrig */ 

/*Reduction factor of the inverse filtering for low energies.*/ 



}; 

static const float hysteresis = l.Of; 



/* Delta value for hysteresis. */ 



The parameters Tavg and TavgSbr are calculated for every inverse filtering band by averaging the tonality values in the 
T and Tsbr matrices over the frequency regions indicated by {rahieNoise according to (outlined for band invBand): 
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X T(^,0) + T(^,1) 

7y,,.„ _ *=fMfe«oi»('ni'S'»irf) 



2 • (froifeivo,.,. {invBand + 1) - fr„M.ivo,.. (invBand)) 

tTMM„„-0'"'Bai"l +l)-l 

Y, Tsbr()t,0) + Tsbr()t,l) 



7 avgSbr = 



2 • (fr„*feiv„,.. {invBand + 1) - fr„M.ivo,.. (invBand)) 

The values are subsequently filtered by a two tap FIR filter according to: 

Tavg Smooth = 0.666666 • Tavg + 0.333333 • Tavgp^^^, 

TavgSbr^^^^^^f^ = 0.666666 • TavgSbr + 0.333333 • TavgSbr^^^^ 

where the Tavgp^^^, and TavgSbr^^^^, are the Tavg and TavgSbr fi^om the previous fi^ame. 

The avgNrg parameter is similarly calculated: 

Nrg(0) + Nrg(l) 
avgNrg = ^—^ ^—^ 

The region borders for the SBR tonality and the original tonality is modified given previous values. The modification is 
done by adding the "hysteresis" value to the upper border of the previous region, and subtracting the hysteresis value 
from the lower border of the previous region. This gives the region-borders used for the detection of the present band in 
the present frame. The following pseudo-code outlines how the hysteresis is applied, where the quantSteps are the 
region border given in detectorParamsAAC. 

if {prevRegion < numRegions) 

quantStepsTmp [prevRegion] = quantSteps [prevRegion] + hysteresis; 
if {prevRegion > 0) 

quantStepsTmp [prevRegion - 1] = quantSteps [prevRegion - 1] - hysteresis; 

The region corresponding to the filtered tonality values for the original and the SBR signal is obtained by finding the 
region that has an upper border higher than the present value, and a lower border lower or equal to the present value. 
This means that if the present value is smaller than the first value in the border vector, the region returned will be zero, 
and so on. 

The regions for the original and the SBR signal are used to index the region space as indicated by the 
detectorParamsAAC, and the inverse filtering level value corresponding to the element pointed out by the region 
indexes is returned. Different region spaces are used for frames where a transient is detected. 

Subsequently an energy compensation is applied. The energy-value calculated from the auto correlation is mapped to a 
region defined in detectorParamsAAC. The index value is subtracted from the inverse filtering level obtained from the 
region space, and this gives the final inverse filtering level stored in the bs_invjilt vector. 

5.6.5 Additional sines estimation 

The additional sines estimation module, estimates for which frequency bands a strong sinusoidal component will be 
missing after high frequency reconstruction in the decoder. The result of the detection may not include a detection of a 
new siusoidal component unless the frame contains a transient, as defined by the transient detector, or unless the 
previous frame contained a transient positioned less than nine QMF slots from the trailing border of the previous frame. 
Such a detection will be removed. 

The detection algorithm firstly calculates the input data upon which detection is done, based on the T and Tsbr values. 
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diff(m,/) = ] \ 2</<4,f,,^,(m)<^<f,,^,(m + l),0<m<A^./& 

max(max(^Tsbr(K,/jj,ll 

I T(^,/) 
sfm(m,/) = >^_:W!M ^ ^ 2<l <4,0<m<Nsfi 

(fH,Jrn + l)-(,,Jm))- H T{k,l) 



fffli*('"+')"f«l*("') 



t«„,h(m+\)-tH;.,h('") 



2 Tsbr(;t,Z) 
sfmSbr (m,Z) = >^_:W!M ^ ^ 2<l<4,0<m< Nsfb 

(f«„.('^ + l)-f«„*('^))- n Tsbr(fc,/) 

The detection system is based on using guide-vectors holding information on previous detections. There are two 
different guide-vectors: 

• guidevectorDiff (has the frequency resolution of the scalefactorbands) 

• guidevectorOrig (has the frequency resolution of the QMF) 

For every frame two tonality estimates in time are available, and hence two estimates in time for the diff, sfm, sfmsbr 
parameters are available as well. For every estimate a detection is done using the guide-vectors from the previous 
detection. The results from the separate detections are finally merged into one decision reflecting the current frame 

The detection algorithm is applied for every estimate, using guide-vectors from the previous detection and producing a 
detection vector and new guide-vectors. The algorithm is outlined below for tonality estimate Ig. 

Firstly, for every scalefactor band the difference signal is compared to a threshold thresTemp. The threshold is 
calculated based on the guide-vectors and a decay-factor according to: 



thresTemp = guideVectorDif f [i] [10] ? 

max {decayGuideDif f *guide 
thresHoldDiff ; 

thresTemp = min {thresTemp, thresHoldDiff) 



max {decayGuideDif f *guideVectorDif f [i] [10] , thresHoldDiff Guide) : 
thresHoldDiff; 



If the difference diff for a scalefactor band is higher than the threshold, the detection vector is set to one for this 
scalefactor band, and the new guide vector is given the current difference value for the present scalefactor band. If the 
difference in tonality is lower than the threshold, but the guide vector indicated that present scale factor band had a 
detected missing sine in for the previous tonality estimate, the guide vector "guide VectorOrig", is assigned the 
thresHoldToneGuide value, in order to track the decay of the original tone instead of the difference signal. This is 
outlined for scalefactor band i, in the following pseudo-code: 

if (diff [i] [10] > thresTemp) { 
detVec [i] [10] = 1; 
guidevectorDiff [i] [10 + 1] = dif f [i] [10]; 

} 
else{ 

if {guidevectorDiff [i] ) { 

guideVectorOrig [i] [10] = thresHoldToneGuide; 



A second detection is done for all scalefactor bands where guideVectorOrig is not zero. The threshold used is calculated 
according to: 

thresOrig = max {guideVectorOrig [i] [10] *decayGuideOrig, thresHoldToneGuide) ; 
thresOrig = min {thresOrig, thresHoldTone) ; 
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If the tonality value in T for any QMF subband within the a scalefactor band is above the threshold the detection vector 
element for this subband is set to one, as well as the new guide vector. The following pseudo-code outlines the second 
round of detection, for scalefactor band /, where // and lu are the lower and upper QMF subband borders for the present 
scalefactor band: 

if (guideVectorOrig [i] [10] ) { 
for{j= 11; j <lu; j++) { 

if(T[j][10] > thresOrig) { 
detVec [i] [10] = 1; 
guideVectorOrig[i] [10 + 1] = T[j] [10]; 



Finally, for every scalefactor band, a detection is done in order to make sure that one single strong sinusoidal in the 
original signal is not replaced (by patching) by several strong sinusoids in the SBR signal. For all scalefactor bands 
larger than one QMF subband, the values of sfm and sfmSbr is compared. This is done according to: 

for{j= 11; j <lu; j ++) { 

if {T[j] [10] > tliresOrig && 

{sfmSbr[i] [10] > sfmTliresSbr && sfm[i] [10] <sfmTliresOrig) ) { 
detVec [i] [10] = 1; 
guideVectorOrig [i] [10 + 1] = T[j] [10]; 



However, for the scalefactor bands only containing one QMF subband the above matrices are defined according to: 

if (T[ll] [10] > tliresHoldTone && 

(diff [ + 1] [10] < l/tliresHoldTone || 

diff [i-1] [10] < l/tliresHoldTone) ) { 

detVec [i] [10] = 1; 

guideVectorOrig [i] [10 + 1] = T[ll] [10]; 
} 

The above is applied for every estimate, i.e. twice per frame. If a new detection is allowed, e.g. there is a transient 
present in the frame, the following additional algorithmic step is performed: 

• Identify adjacent scalefactor bands where detection of a missing sine is done in both bands 

• Find the QMF subband within each scalefactor band that has the highest tonality 

• If the QMF subband with the highest tonality value are adjacent, remove the detection for the scalefactor band 
with the lowest tonality. 

Finally the detection decisions from the different detections are merged together, according to: 

for{i = 0; i< nSfb; i++) { 

for{est = start; est < totNoEst; est++) { 

bs_add_liarmonic [i] = bs_add_harmonic [i] | | detVec [i] [est] ; 

} 
} 

Here start equals two if the newDetectionAUowed flag is set, otherwise it is set to zero. 



If the newDetectionAUowed flag is not set, detections that were not present before are removed, according to: 

if { ! newDetectionAUowed) { 
for {i=0;i<nSfb;i++) { 

if {bs_add_liarmonic [i] - prev_bs_add_liarmonic [i] > 0) 
bs add liarmonic [i] = 0; 



Apart from detection in which scalefactor band a sinusoidal should be added the module also calculates an energy 
compensation vector. This is used in the envelope estimation module. 
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For every scalefactor band where a missing sine has been detected the maximum tonality value in the T matrix is found, 
indicated by maxPosF (indicating the subband) and maxPosT (indicating the QMF slot). If maxPosF coincides with a 
scalefactor band border and a detection was not done for the adjacent scalefactor band, a compensation value is 
calculated according to (here outlined for the case where the maxPosF value coincides for the lower scalefactorband 
border): 

compValue = (int) {f abs {IL0G2*log {dif f [i - 1] [maxPosT] +EPS) ) + 0.5f); 
if {compValue > maxComp) 
compValue = maxComp; 

if { IpAddHarmonicsScaleFactorBands [i-1] ) { 

if (tonality [maxPosF -1] [maxPosT] > tonalityQuota*tonality [maxPosF] [maxPosT] ) { 
compVec[i-l] = -l*compValue; 



Finally the detection algorithm compensates for the case where a strong sinusoidal is present in the patched SBR signal 
where there were no strong sinusoidal in the original, and at the same time there is a sinusoidal missing in the adjacent 
scalefactor band. This is done for all scalefactor bands where a sine is missing (except for the first and the last 
scalefactor band), according to the following: 

compValue = (int) {f abs {IL0G2*log {dif f [i - 1] [maxPosT] +EPS) ) + 0.5f); 
if {compValue > maxComp) 
compValue = maxComp; 

if {1/diff [i-1] [maxPosT] > dif fQuota*dif f [i] [maxPosT] ) { 

compVec[i-l] = -l*compValue; 
} 

compValue = {int) {f abs {IL0G2*log {dif f [i + 1] [maxPosT] +EPS) ) + 0.5f); 
if {compValue > maxComp) 
compValue = maxComp ; 

if {1/diff [i+1] [maxPosT] > dif fQuota*dif f [i] [maxPosT] ) { 

compVec [i+1] = compValue; 
} 

The bitstream element bs_add_harmonicJlag is set to one if any element of the bs_add_harmonic is not zero, 
otherwise it is set to zero. 



5.7 Data quantization 



The spectral envelope scalefactors are quantized in 3dB steps or in 1 .5dB steps, dependent on the time frequency 
resolution of the current SBR frame, and bs_amp_res. For the case where there is only one SBR envelope per SBR 
frame and of SBR frame class FIXFIX, 1 .5 dB steps are always used, disregarded the value of bs_amp_res. 

For mono and stereo without channel coupling the quantization is done according to: 

f 



EQ{k,l) = INT 



log; 



fl-max 



E{k,l) 



,0 



+ 0.5 



-acompgain{l^ ,0<k <nfr(/)) ,0<l < L^ 



\2 ,bs_amp_res = IcompVecil) ,r(l) = HI,compVec(l)>0 

where a = i and comgainU) = < 

[1 ,bs_amp_res = \ lO , otherwise 

For the coupled channel mode, the left channel is quantized according to the above, while the right channel should be 
quantized according to: 

^QR,gh, ('^'O = INT [a ■ log2(E(;t,/)) + 0.5) + panOffset{bs_amp_res) 

The noise floor scalefactors data is always quantized in 3dB steps. For stereo without channel coupling and for mono 
the channels are quantized according to: 
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QQ{k,l) = INT(nOISE _FLOOR_OFFSET -log^{Q{k,l)) + 0.5). 

where Qg (^,/) shall be limited to the interval [0,30] . 

For coupling however, the right and left channels are quantized according to: 



QaR,UkJ) = INT 



' 'QuAkJ)^ ' 



log. 



Q.„.,(^>0 



+ 0.5 



+ panOffset(l), 



r 



QoLef, {k,l) = INT NOISE _ FLOOR _OFFSET-log- 



Qu,{kJ) + Q,,,UkJ) 



V 



+ 0.5 

J J 



where 



Qg^,-,, (^,/) shall be Hmited to the interval 0,2-panOffset(l) and Q_Qtef,{k,l) is Hmited to the interval 
[0,30]. 

In the case of coupling, the Qg;;,,^ {k.,1) andEg^. ^, {k,l) values shall be quantized to multiples of two, e.g. 
[0,2,4,6,8...]. 

5.8 Envelope and noise floor coding 

The spectral envelope scalefactors and noise floor scalefactors are delta coded in either the time direction or the 
frequency direction, according to the preferred choice indicated in bs_df_env(/) and bs_df_noise(/). The 
bs_df_env and bs_df_noise elements are chosen so that the total number of bits required for coding the scalefactor 
data of the present frame is minimised, with the reservation for the case when reset = 1 . In this case delta coding in the 
time direction is not allowed for the first SBR envelope or noise floor of that SBR frame. 

The above minimization of envelope bits are for stereo done in both coupling and left/right stereo mode and based on 
this the stereo mode is chosen so that the total number of bits required is minimized. 

Below the delta coding of envelope scalefactors and noise floor scalefactors are defined. 
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^Oe,a{kJ) = 



S-Eq{0,1) 



S-(EQ{k,l)-EQ{k-l,l)) , 



S-(g,{k,l)-E^{k,l)) 



S-(g,{i{k),l)-E^{k,l)) , 



S-(g,{i{k),l)-E^{k,l)) , 



0<1<L^ 

,\k = 
bs_df_env(Z) = 

0<1<L^ 
l<k<n{r{l)) 
bs_df_env(/) = 
0<1<L^ 
0<k<n{r{l)) 
bs_df_env(/) = l 

0<1<L^ 

0<k<n{r{l)) 
bs_df_env(/) = l 

^(0 = 1 

i[k) is defined by 

'-TabUHigh V H J / ~ '-TaUeLoK \k) 

0<1<L^ 
0<k<n{r{l)) 
bs_df_env(/) = l 

g{l) = 

i[k) is defined by 



TahleLinv 



{i{k))^fraM.H.Jk)<f,^,,,,^.{i{k) + l) 



[0.5 if ch = \ AND bs _ coupling = 1 
where o =\ 



1 otherwise 



and, 



where g^{k,l^ and g(/) is defined below. As E„ represents the envelope scalefactors for the current SBR frame, 
the envelope scalefactors from the previous SBR frame is denoted E„ . Envelope scalefactors from the previous SBR 
frame. Eg is needed when delta coding in time direction over SBR frame boundaries. The number of SBR envelopes of 
the previous SBR frame is denoted L^ , and is also needed in that case, as well as frequency resolution vector of the 
previous SBR frame, denoted r'. 



§£(^'0 = 



Ee(fc,/-1) 

Eg (^,4-1) 



|1</<L^ 

[0<^<n(r(/)) rr(/_i) ,i<z<l, 

and g{l] = < , , 
[/ = ^^ lr'(4-l) >^ = 

10<;t<ii(r(/)) 
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The delta coding of the noise floor scalefactors are defined as: 



Qoe,.AkJ) = 



SQq{0,1) 



^•(Qg(^,/)-Qg(^-l,/)) 



S-(Q^{k,l)-Q'^(k,L'Q-l)) 



S{QQ{k,l)-QQ{k,l-l)) 



0<1<L 



'Q 



bs_df_noise(/) = 

0</<Lg 
1 < ;t < A^g 
bs_df_noise(/) = 

/ = 

bs_df_env(/) = l 
1 < / < Lg 
0<k<NQ 
bs_df_env(/) = l 



where 



s= 



[0.5 if ch = \ AND bs _ coupling = 1 
1 otherwise 



and where Q is the noise floor scalefactors from the previous SBR frame and Lq is the number of noise floors from 

the previous SBR frame. Qoeitai^'^) ^"'^ ^oe/M (^'0 ^e stored as bitstream element as shown below prior to 
Huffman coding. 



bs_data_noise \ch\ [/] \k\ = Q^,^,^ {k,l) , 



\0<k<N. 



Q 



0</<L, 



bs_data_env[ch][l][k] = E^^„^{k,l) ' o<yt<n(r(/)) 



For the envelope scalefactors and the noise floor scalefactors different Huffman tables are used dependent on coding 
directions, quantization and stereo mode, according to in [1], sub clause 4. A. 6.1 Table 4.A.76 



Bitstream 



Figure 10 below gives a brief hierarchical representation of the SBR and parametric stereo parts of the aacPlus 
bitstream, with references to the corresponding decoder specifications. An overview of sbr_extension_data() is given in 
[1], Figure 4. 19 A, and subclause 4.4.2.8 of [1] defines the syntax. Clearly, the operation of the SBR Bitstream 
Multiplexer in Figure 5 is defined by this syntax. The optional CRC calculation is also defined by the decoder 
description [1], subclause 4.5.2.8.1. For convenience, pointers to the relevant sections in the present document are 
given within paranthesises in Figure 10. 



extension_payload { ) 
sbr_extension_data { ) 
sbr_header { ) 
sbr_data { ) 

sbr_single_channel_element { ) 
sbr_grid { ) 
sbr dtdf {) 



[1] , Amendment Subpart 4, Table 4.51 
[1] , Subclause 4.4.2.8, Table 4 . 54A 

Table 4.55A (5.3) 

Table 4.56A 

Table 4.57A 

Table 4.61A (5.4.3) 

Table 4.62A (5.8) 
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sbr invf { ) 


" 


", Table 4 


63A 


{5 


6.4) 


sbr envelope { ) 


" 


" , Table 4 


64A 


{5 


5, 5.7, 5.8) 


sbr noise {) 


11 


" , Table 4 


65A 


{5 


6.3, 5.7, 5. 


sbr sinusoidal coding {) 


" 


" , Table 4 


66A 


(5 


6.5) 


sbr extension {) 


[7 


, Subclause 


8. A 


2, 


Table 8.A.1 


ps data{) 


[7 


, Subclause 


8.4 


1, 


Table 8.1 



Figure 10: Enhanced aacPlus with parametric stereo bitstream hierarchy 
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